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What is claimed is; 
^1. A method of searching multimedia data con^rising; 

al) receiving at least one referenc^ multimedia data 
selected by a user, wherein the referorice multimedia data 
represents a specified multimedia data %o be searched; and 

bl) searching for the specif iedymultimedia data utilizing 
features and feature elements of thor respective features included 
in said at least one reference inultimedia data, by considering 
a degree of affect each feature and each feature elements should 
have in the search* 



2, A method of c^im 1, wherein in bl) , searching for the 
specified multimedia data utilizing a combination of features and 
feature elements of the respective features included in said at 
least one reference multimedia data, wherein each feature has a 
feature/weight and each feature element has a feature element 
weigt 



3, A method of claim 2, wherein in a^ a plurality of reference 
20 multimedia data are selected by^ the user, and wherein bl) 
comprises : 

a2) measuring the irities of features included in the 

plurality of referenp^ mujLtimedia data; 

b2) determi;sflng weights of each feature according to the 
25 measured similarities of the features in a2); 
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c2) measuring the similarities yof the feature elements in 
each feature included in the plur^ity of reference multimedia 
data; 

d2) determining weights/ of each feature elements in 
respective features accordjf,n^^;€'o the measured similarities of the 
feature elements in c2);^STid 

e2) searching foj^/thjb specified multimedia data utilizing 
features and feature elements included in the plurality of 
reference multimedia data, in consideration of the updated 
features weight/ and feature element weights. 



4. A method of claim 3, further comprising terminating the 
search if the user is satisfied with t>e result of the search, 
otherwise the method comprising: 

fl) receiving at least one yfcher reference multimedia data 
selected from among the resullrant images of the search, wherein 
said at least one other reference multimedia data is determined 
to be similar to the sp^^ified multimedia data; 

gl) measuring th/ similarities of features included in the 
plurality of refe^nce multimedia data and said at least one 
other reference ifmltimedia data; 

hi) determining and updating weights of each feature 
according to the measured similarities of the features in gl) ; 

il) /measuring the similarities of the feature elements in 
each f/ature included in the plurality of reference multimedia 



data and said at least one oth^r reference multinfedia data; 

jl) determining and updating weights (A each feature 

elements in respective features according/ to the measured 

similarities of the feature elements in ilj// and 

5 kl) re-searching for the specified mu/timedia data utilizing 

features and feature elements includ/d in the plurality of 

reference multimedia data and in /said at least one other 

reference multimedia data, in co^^isideration of the updated 
C3 7 

U features weights in hi) and feat/re element weights in jl). 

5. A method of claim 4, fu/ther comprising: 
13 11) receiving at lea/st one dissimilar multimedia data 

C3 selected from among the r/sultant images of the search, wherein 
iJ said at least one dissimilar multimedia data is determined to be 
CS dissimilar to the specified multimedia data; 

ml) measuring the dissimilarities of features included in 

the plurality of reference multimedia data and said at least one 

dissimilar multimedia data; 

nl) measur/ng the dissimilarities of the feature elements 
20 in each featurer included in the plurality of reference multimedia 

data and said at least one dissimilar multimedia data; and 

wherei/n in hi) determining and updating weights of each 

feature elements in respective features according to the measured 

dissimilarities of the feature elements in gl and ml) ; 
25 wMerein in jl) determining and updating weights of each 
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feature elements in respective features according tc^'the measured 
dissimilarities of the feature elements in il) a^d nl) ; and 

wherein in kl) re-searching for the speolfied multimedia 
data utilizing features and feature element^ included in the 
plurality of reference multimedia data, i/n said at least one 
other reference multimedia data and im said at least one 
dissimilar data, in consideration of the/updated features weights 
in hi) and feature element weights i/ jl) . 

6. A method of claim 3, further comprising terminating the 
search if the user is satisfiecr with the result of the search, 
otherwise the method comprising: 

f2) receiving at least /one dissimilar data multimedia data 
selected from among the resultant images of the search, wherein 
said at least one dissimilar data multimedia data is determined 
to be dissimilar to the/ specified multimedia data; 

g2) measuring th^e dissimilarities of features included in 
the plurality of reference multimedia data and said at least one 
dissimilar data multimedia data; 

h2) determining and updating weights of each feature 
according to theineasured dissimilarities of the features in g2) ; 

i2) measuring the dissimilarities of the feature elements 
in each featu^ included in the plurality of reference multimedia 
data and saia at least one dissimilar data multimedia data; 

j2) determining and updating weights of each feature 
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elements in respective features according to the yft\easured 
dissimilarities of the feature elements in 12) ; and 

k2) re-searching for the specified multimedia dat6 utilizing 
features and feature elements included in the ^plurality of 
reference multimedia data and in said at least yDne dissimilar 
data multimedia data, in consideration of the yOpdated features 
weights in h2) and feature element weights ii/ j2) . 
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7, A method of claim 2, wherein in al) o/e reference multimedia 
data is selected by the user, and where/n b) comprises searching 
for the specified multimedia data uti/izing features and feature 
elements of the respective features included in said reference 
multimedia data, wherein each fea/cures has a feature weight and 
each feature element has a feature element weight. 

8. A method of claim 7, /further comprising terminating the 
search if the user is sat/sfied with the result of the search, 
otherwise the method corfiprising: 

a3) receiving at /least one other reference multimedia data 
selected from among the resultant images of the search, wherein 
said at least one osther reference multimedia data is determined 
to be similar to /the specified multimedia data; 

b3) measui?lng the similarities of features included in said 
reference muJiximedia data and said at least one other reference 
multimedia /aata; 
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c3) determining and updating weights of ea<^ feature 

according to the measured similarities of the featu/es in b3) ; 

d3) measuring the similarities of the featuwfe elements in 

each feature included in said reference multimed/a data and said 

5 at least one other reference multimedia data; 

e3) determining and updating weight/ of each feature 

elements in respective features accord/ng to the measured 

similarities of the feature elements inyxi3) ; and 

."Sj f3) re-searching for the specified/multimedia data utilizing 

l5) features and feature elements in/luded in said reference 

fu multimedia data and in said at /least one other reference 

/ 

14 multimedia data, in consideration/of the updated features weights 
i-, in c3) and feature element weioTits in e3) . 

15 9. A method of claim 8, mrther comprising: 

g3) receiving at le4st one dissimilar multimedia data 
selected from among the /esultant images of the search, wherein 
said at least one dissi^milar multimedia data is determined to be 
dissimilar to the sp/cified multimedia data; 

20 h3) measuringy/the dissimilarities of features included in 

said reference multimedia data and said at least one dissimilar 
multimedia data/ 

13) meaaaring the dissimilarities of the feature elements 
in each fea;ture included in said reference multimedia data and 

25 said at ^east one dissimilar multimedia data; and 
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wherein in c3) determining and updating weights of each 
feature elements in respective features according toAhe measured 
dissimilarities of the feature elements in b3) ai/d h3); 

wherein in e3) determining and updating /weights of each 
5 feature elements in respective features according to the measured 
dissimilarities of the feature elements in/d3) and 13); and 

wherein in f3) re-searching for thfe specified multimedia 
C3 data utilizing features and feature eiements included in said 
=5 reference multimedia data, in said least one other reference 
is multimedia data and in said at l/ast one dissimilar data, in 
in consideration of the updated fea^res weights in c3) and feature 
s_ element weights in e3) . / 

t;f 10. A method of claim 7, /further comprising terminating the 
II search if the user is sat/isfied with the result of the search, 
otherwise the method comprising: 

a4) receiving at /east one dissimilar data multimedia data 
selected from among /he resultant images of the search, wherein 
said at least one dassimilar data multimedia data is determined 
20 to be dissimilar Lo the specified multimedia data; 

b4) measur/ng the dissimilarities of features included in 
said reference^ multimedia data and said at least one dissimilar 
data multimeqia data; 

c4) /etermining and updating weights of each feature 
25 according to the measured dissimilarities of the features in b4) ; 
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d4) measuring the dissimilarities aff the feature elements 
in each feature included in said reference multimedia data and 
said at least one dissimilar data itmltimedia data; 

e4) determining and updating weights of each feature 
elements in respective features according to the measured 
dissimilarities of the feature elements in d4); and 

t4) re-searching JPor the specified multimedia data utilizing 
features and featture elements included in the plurality of 
reference multizfiedia data and in said at' least one dissimilar 
data multime^a data, in consideration of the updated features 
weights c4) and feature element weights in e4). 

11. A method of claim 2, wherein the feature is a color and the 
feature element weights are determined either by a color 
histogram with n color elements as the feature elements, or by 
dividing a multimedia data into n*m grid regions and utilizing 
a regional color histogram or a color representing a grid region 
as the feature elements, 

12. A method of claim/ll, wherein a feature element with a 



are utilized in 



feature element wei 




search . 



greater than a specified threshold value 



13. A data structure comprising: 

a feature inf ormatiorylTicluding feature and feature elements 



of an image; anc 

a weight information including weight information of said 
features and wejight information of said feature elements 



in 
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14. A method /of claim 13, wherein the feature and the feature 
elements are /represented by an image characteristic structure 
comprising: 

a glob^al information which represents a feature of a whole 
image; ana 

a spatial information which represents a feature of an image 
regioj 



fj5 
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15. A method of claim 14, wherein th^ image characteristic 
structure further comprises a weight information which represents 
the importance of the global information and the spatial 
information. 

16. A method of claim ll5^ wherein the global information 
includes global feature /djescriptors of the whole image and 
element weight descriig^ors for the feature elements of the 
respective global feeture descriptors^ and wherein the spatial 
information includes spatial feature descriptors of image regions 
and position weight descriptors for respective image region. 
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A method of claim 14, wherein the global information 
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includes global feature descriptors of/ the whole image and a 
weight information which represents th4 importance of the global 
feature descriptors and the importano^ of feature elements of the 
respective global feature descriptors; and the spatial 
information includes spatial featu/e descriptors of image regions 
and a weight information whicly represents importance of the 
respective image regions 



^10 



13 

Li: 
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18. A method of claim 1^ )\^\i^T^xvi the feature and the feature 
elements are represented lpy\aa image characteristic structure 
comprising ; 

a global inf ormatioA; 
a local information; and 
a local position information. 

19. A method of claAm 18, wherein the features are color and 
texture and wherein/ the global information includes a global 
color feature unit fend a global texture feature unit; the local 
information includes a local color feature unit, a local texture 
feature and a locaO, color and texture feature unit; and the local 
position information includes a local position color feature unit 
and a local posj/tion texture feature unit. 
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20, A method it claim 19, wherein the global color feature unit 
is representedr by a global color histogram, the global texture 
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feature unit is represented /by a global texture histogram, the 
local color feature unit And the local position color feature 



unit are represented 
texture feature unit 



a color image grid 1012, the local 
fid\the local position texture feature unit 
are represented by / texture image grid and the local color and 
texture feature uraat is represented by both the color image grid 
and the texture/image grid. 
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